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ABSTRACT 

In  this  paper  quantization  scheaes  are  con¬ 
sidered  for  the  coefficients  of  dlacrete-tlae  fin¬ 
ite-  Impulse-response  filters  for  est last ion  and  de¬ 
tection.  For  filter  lapulse-response  sequences  of 
length  J,  we  consider  the  optlaua  choice  of  a  snall- 
er  Dunbar  K  of  coefficient  values  and  their  dis¬ 
tribution  over  the  J-aaaple  filter  sequence.  The 
quantized  filters  are  optialzed  with  respect  to 
estlaation  or  detection  perforaance  criteria,  and 
recursive  algorithas  are  developed  for  use  in  find¬ 
ing  numerical  solutions.  Results  we  give  indicate 
that  in  general  only  a  few  levels  give  good  per¬ 
formance. 

I.  INTRODUCTION 

The  use  of  matched  filters  and  Wiener  filters 
is  widespread  as  signal  processing  elements  in  many 
applications.  In  many  situations  such  filtering  is 
performed  on  dlacrete-tlae  data  sequences,  and  the 
filter  is  implemented  as  the  convolution  of  a  fin¬ 
ite  impulse-response  sequence  with  the  data  sequence 
Wiener  filtering  is  performed  when  the  data  repre¬ 
sents  a  noisy  random  signal  which  la  to  be  estima¬ 
ted  with  minimum  mean-square-error (MSE) ,  whereas 
matched  filtering  can  be  used  to  maximize  the  out¬ 
put  Blgnal-to-noise  ratio  (SNR)  at  specific  times 
when  the  input  is  a  noisy  version  of  some  deter¬ 
ministic  signal. 

Let  (x  }  represent  an  observation  sequence  of 
a  signal  (»')  and  additive  zero-mean  noise  {w 
Suppose  this  sequence  la  to  be  convolved  wlthca 
finite  lapulse-response  sequence  {g^jj  of  length 

J.  In  estimation  problems  the  output  (y  )  may  be 

required  to  be  an  estimate  of  {v-  }  for  Borne  in¬ 

teger  n.  Similarly  in  matched  filtering,  the  out¬ 
put  values  (y^J+ajt)  for  some  fixed  repetition  in¬ 
terval  J+m  may  be  required  to  have  SNR 

values.  In  general,  optimization  of  the  filter 
lapulse-response  sequence  results  in  a  specific 
sequence  of  J  different  numerical  values.  In  many 
applications,  however,  we  may  be  interested  in 
using  a  smaller  number  K  of  distinct  values  in 
forming  tha  filter  impulse-response  sequence  of 
length  J.  This  may  be  desirable  (a)  to  allow  the 
filter  to  be  easily  updated  la  adaptive  systaas, 

t Thit  >uuta/ieh  it  tupponXtd  by  thl  Kin  Fonct 
OOict  of  ScivUific  Rtttanch  u tide*  QntuU  KFOSK 
tt-OOtt. 


(b)  a*  a  first  step  in  obtaining  sub-optimum  but 
computationally  efficient  scheaes,  or  (c)  to  pro¬ 
vide  a  degree  of  robustness  of  performance  under 
deviations  from  assumed  signal  and  noiae  character¬ 
istics. 

We  will  refer  to  partitioning  of  the  J  impulse- 
response  samples  Into  K  groups,  with  each  of  which 
a  distinct  level  is  associated,  as  quantization  of 
the  impulse-response  sequence.  In  considering 
optimum  quantization  It  is  natural  to  use  as  a 
criterion  of  performance  the  original  criterion  of 
minimizing  the  MSE  or  maximizing  SNR.  In  addition 
one  can  also  look  for  a  "best-fit"  quantization  of 
the  optimum  filter,  for  example  by  minimizing  mean- 
squar e-deviation  between  the  optimum  and  quantized 
impulse-response  sequences.  We  will  consider  these 
quantization  schemes  and  give  numerical  performance 
results  in  the  rest  of  this  paper.  It  will  be 
seen  that  in  many  cases  system  perforaance  with  a 
low-order  quantization  can  be  expected  to  be  quite 
dose  to  optimum  performance. 

In  earlleT  work  [1]  quantization  of  the  co¬ 
efficients  of  a  matched  filter  was  considered,  for 
white  noise  and  low  input  SNR.  In  (2]  quantiza¬ 
tion  of  the  Wiener  filter  frequency  response  was 
considered.  In  another  recent  paper  [3]  computa¬ 
tionally  efficient  "multiplication-free"  imple¬ 
mentations  of  quantized  Wiener  filters  and  equal¬ 
izers  have  been  considered. 

II.  OPTIMUM  QUANTIZED  FIR  WIENER  FILTERS 

With  our  previous  notation,  the  output  of  an 
FIR  filter  la 

J-l 


Defining  h*  -  g^  and  •1  -  ve_1+l,  -  »t.1+1 

*ad  rl  *  xt-l+l  for  1-1,2 . J,  we  have  yr  -  h+r  - 

t  t  —  — 

h  (s  +  n)  where  +  means  conjugate-transpose  and 
where  the  vectors  are  column  vectors  of  corres¬ 
ponding  components  Indexed  from  1  to  J.  For  Wiener 
filtering  (with  zero-mean  s)+l*t  the  quantity  to  be 
estimated  at  time  t  be  d  -  h.s,t where  h,  is  some 
given  J-vector.  For  example, h,  could  Be  [1,0,..., 

0,0)  to  estimate  v.  from  x„,  x.  x.  ... .  For 

t  t  t— i  t— j— 

a  given  filter  h,  the  MSE  e(h)  between  y  and  d 
can  be  obtalned-as  .  +  1 

*(h)  -  J^Sh,  +  h  R  h  -  2  Relh  C  h^},  (1) 
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where  S  ■  E(s  } ,  R  ■  Elr  /}  ud  C  *  s*}.  The 

fllcer  min lairing  e(h)  is  given  by 

^  -  R^Chj. 

For  any  K-th  order  quantized  filter  (with  K 
groupa)  define  a  grouping  matrix  Q  *  such 

that  »  1  if  jcl^,  the  k-th  of  K  groups,  and  Cj^ 

•  0  otherwise.  Each  column  of  Q  has  a  single  non¬ 
zero  entry.  Let  the  level  associated  with  the 
k-th  group  be  Hj^,  k-l,2,...K.  Thus  h^  *  H^  if  (J^ 

•  1.  From  this  it  fallows  that  for  such  a  quan¬ 
titated  filter  h  •  Q  H  where  the  level-vector  H  - 

lHr  V  -"V1- 


For  a  K-th  order  quantized  filter  the  MSE  be¬ 
tween  y  and  d  is  obtained  by  replacing  h  with  Q H 
in  (1).  For  given  Q  the  optimum  level-vector 
is  easily  obtained  to  be 

Ho  -  (QRQ+)‘Vhj.  (2) 

and  an  expression  for  the  resulting  MSE  can  be 
found  directly  from  (1). 

Next  we  consider  the  case  where  the  quantized 
filter  levels  are  given.  This  is  useful  in  prac¬ 
tice  when  the  levels  are  fixed  for  simplicity  of 
implementation.  The  following  theorem  gives  a 
necessary  condition  on  the  optimum  grouping  to 
minimize  the  MSE. 


where  b  »  (H  +  H  ,)/2  for  m-1,2, . . . ,K-l(bn 

ID  IB  OTrl  U 


bR  -  and 


K 


«.>■<«*,>,-  J,VV  <s> 

qel 


If  the  lower(upper)  equality  in  (4)  holds,  p  can  be 

removed  from  I  and  assigned  to  I  .  , .(1  ,  ., .) 

om  o(m-l)  o(m+l) 

without  increasing  the  MSE. 


The  proof  is  given  in  [4].  Now  it  is  obvious 
that  for  the  case  of  real  quantities,  the  optimum 
quantized  levels  H  (indexed  in  Increasing 
order)  and  the  corresponding  optimum  groups  I 
must  satisfy  simultaneously  (2)  and  (4).  Based  on 
these  necessary  conditions,  a  recursive  algorithm 
can  be  developed  to  find  particular  solutions  for 

H  4  and  I  . . 
ol  oi 


Algorithm  I. 

1)  Initialize:  “  KxJ  null  matrix. 

Input:  Initial  guess  of  grouping  matrix,  Q. 

2)  Find  H  from  (2).  Re-index  to  get  elements 
of  H  ~?n  rank  order.  Interchange  rows  of  Q 
likewise. 

3)  If  Q  •  q\  stop.  Current  and  Q  then  repre¬ 
sent  candidate  for  optimum  quantization.  Other¬ 
wise,  set  Q1  »  Q  and  continue. 


Theorem  I.  Let  the  level-vector  H  of  K  distinct 
levels  be  given,  and  let  I  .  ,  k  -  1,2,...,K  de¬ 
note  the  corresponding  optimum  groups.  If  pci  , 
then  R  °” 

Re{(H  *  -  H I  *)[  I  2H  l  R  +  (H  +  H)R, 
n  “  ,._i  *  pq  n  m  i 


k-1 


PP 


ok 


-2(Cha)p]>  a  0, 


(3) 


for  all  n  ^  m,  where  R  is  the  pq-th  element  of  R 
and  (Ch,^,  is  the  p-th  Element  of  Ch ..  If  the  eq¬ 
uality  in  (3)  holds  for  a  specific"!!,  p  can  be 
moved  from  I 
ing  the  MSE.° 


and  assigned  to  I  without  chang- 
on 


The  proof  can  be  found  in  (4].  When  R  is 
diagonal,  the  first  term  in  the  bracket  in  (3) 
vanishes,  and  (3)  is  essentially  a  necessary  and 
sufficient  condition  [within  the  ambiguity  caused 
by  the  equality  in  (3)].  From  the  above,  optimum 
quantized  filter  levels  and  optimum  groups  which 
jointly  minimize  the  MSE  must  satisfy  (2)  and  (3) 
simultaneously.  Note  that  (2)  end  (3)  provide 
only  necessary  conditions  for  the  optimum  quantized 
Wiener  filter. 


The  results  In  Theorem  I  can  be  simplified  if 
the  quantities  Involved  are  real.  This  is  given 
by  the  following  theorem. 


Theorem  II.  Assume  that  all  quantities  are  real, 
and  assume  an  Indexing  for  the  given  filter  levels 
such  that  mvl,2,...,K-l,  without  loss  of 

generality.  Let  I  be  the  corresponding  m-th 

optimum  group.  If™eI_,  than 

on 

bm-l  4  f(p)  4  b«  <*> 


4)  Compute  b  vector  and  f(p),  P”l,2 . J  of 

Theorem  2.  Assign  p  to  m-th  group  if  b  j 

<  f(p)  <  b  .  and  obtain  new  Q.  Go  to  step  2. 

B 

Different  initial  guesses  of  Q  may  lead  to 
different  candidates  for  the  optimum  quantization, 
since  the  algorithm  is  based  on  the  necessary  con¬ 
dition  for  optimality.  In  practice,  from  several 
initial  guesses  one  can  pick  the  best  result  ob¬ 
tained.  The  algorithm  generally  converges  rather 
quickly  when  it  does  converge,  and  can  be  used  to 
obtain  at  least  very  good  sub-optimum  schemes  when 
the  MSE's  of  the  non-quantized  and  resulting  quan¬ 
tized  filters  are  close.  Note  that  minor  modif¬ 
ications  in  the  above  algorithm  allow  it  to  obtain 
candidates  for  the  optimum  Q  for  given  H. 

The  algorithm  will  fall  to  converge  if  the  re¬ 
sult  at  the  r-th  step  is  the  same  as  the  result  at 
the  s-th  step  for  some  r  >  e+1.  If  at  some  step 
one  or  more  groups  contain  no  element-index,  l.e. 
if  one  or  more  rows  of  Q  are  all  zero,  the  iter¬ 
ations  cannot  continue  because  then  QRQ+  cannot 
be  inverted.  This  can  happen  because  of  a  bad 
choice  for  the  initial  guess  or  if  the  optimum 
(unquantized)  filter  requires  less  than  K  distinct 
levels. 

III.  OPTIMUM  QUANTIZED  FIR  MATCHED  FILTERS 

With  the  same  notation  as  that  used  in  Section 
II,  we  find  that  the  SNR  for  the  output  y£  is 

p(h)  -  |h+s|2/hNh  (6) 

where  N  ■  E(n  n+}.  The  filter  maximizing  p(h) 
is  h^  ■  N  2s.  For  a  K-th  order  quantized  filter 


3 


Che  output  SNR  it  obtained  fro*  (6)  by  replacing 
h  with  Q+H.  For  gives  Q  the  optima  level-vector 
^  la  easily  obtained  to  be 

^  -  (QNQ+)-1  Qa,  (7) 

and  an  expression  for  the  resulting  SNR  can  be 
found  directly  fro*  (6). 


Thus  H  .  is  tbs  average  of  the  optima  levels  for 
the  k-A  group.  For  gives  level-vector  H.  we  have 
wae  following: 

Theorem  IV.  Let  I.,  i  -  1,2,...,K,  denote  the 
optima  groups  minimizing  e  for  given  quantized 
filter  level-vector  H.  If  pci _ ,  then 


Unlike  the  Wiener  filtering  problem,  no  ex¬ 
plicit  result  on  the  optima  grouping  has  been 
obtained  for  the  case  of  given  quantized  filter 
levels.  However,  a  necessary  condition  slailar  to 
that  in  the  previous  section  can  be  found  if  we  con¬ 
sider  jointly  the  optima  quantized  filter  levels 
and  the  optima  grouping. 

Theorea  III.  Let  H  .,  I  .,  1*1,2, ...  ,JC  denote  the 
optima  quantized  filter°levela  and  the  optlaua 
groups  which  Jointly  naxlsd.se  the  output  SNR.  If 
and  I  ±  satisfy  (7)  and  the  follow- 


Re{ (H  *  -  H  *)h  )  a  1/2  ( | H_ \2  -  |h|2)  (13) 

n  a  op  n  ■ 

for  all  n  i  a.  In  addition,  if  (13)  is  true  with 
strict  inequality  for  all  n  d  a  and  son*  p,  then 
pel  .  If,  for  soae  p,  (13)  is  true  for  all  n  ^  a 
but  “e  equality  in  (20)  holds  for  soae  specific 
n*j,  then  p  can  belong  to  either  I  or  I  .  More¬ 
over,  if  the  quantities  Involved  a?!  realand 
RjtHjC. .  then  (13)  reduces  to 

b-l  *  hop  4  b.  (14> 


**<  OO  1  X2Hokq$/Pq  +  (H^  "omVp1* 

qElok 

2  0  (8) 

for  all  n  4  a.  If  the  quantities  involved  are 
real,  we  can  reduce  (8)  (by  assuaing  HQi< 

without  loss  of  generality)  into 


ba-l  *  f<P>  *  \  <9> 

where  -  <8^+  *o(-rt))/2  For  a-1,2 . K-l 


(bo  *  bK 


f(p)  -  (s  -  l  H 


k-1 


)/N  . 

pq  pp 


(10) 


qtl 


ok 


The  proof  is  given  in  (4J.  It  is  interesting 
to  note  the  slailarltles  between  (8)  and  (3),  or 
(9)  and  (4).  Hence,  for  the  case  of  real  quan¬ 
tities,  an  algorltha  similar  to  Algorithm  I  can 
be  developed  to  find  specific  candidates  for  the 
optiaua  quantized  matched  filter. 


IV.  BEST-FIT  QUANTIZATION  OF  OPTIMUM  FILTHS 


where  b_ 
m 


bK- 


*  (Hn  +  Vl)/2  for 

-). 


a-1,2. 


,K-1  (bQ  - 


The  results  in  Theorea  IV  are  obtained  froa 
the  property  that  pci  if  and  only  if  the  summand 

-  OB 

|H  -  h  |  in  (11)  is  the  smallest  among  all 
a  °P  2 

|H^  -  h  |  ,  k-l,2,...K.  The  proof  Is  oaitted. 


Froa  the  above,  the  best-fit  quantized  filter 
levels  H  .  and  the  best-fit  groups  I  .  which  joint¬ 
ly  minimize  the  ISE  aust  satisfy  (12?  and  (14) 
simultaneously  for  the  case  of  real  quantities. 
These  two  equations  provide  only  necessary  con¬ 
ditions.  An  algorltha  similar  to  Algorithm  I  can 
be  developed  to  find  particular  candidates  for  the 
best-fit  quantized  filter. 


Before  we  proceed  to  give  numerical  examples, 
we  note  that  the  best-fit  quantization  of  optimum 
filters  is  not,  in  general,  the  same  as  the  optiaua 
quantization  discussed  in  Sections  II  and  III. 
Clearly,  the  best-fit  quantized  filter  will  have 
somewhat  higher  MSE  in  Wiener  filtering,  and  some¬ 
what  lower  SNR  in  matched  filtering. 


V.  NUMERICAL  EXAMPLES 

The  two  examples  la  this  section  illustrate  the 
use  of  the  results  we  have  obtained. 


One  approach  to  finding  a  reasonable  quantiza¬ 
tion  of  a  J -coupon ant  optima  filter  t^lnto  s  K- 
valued  filter  is  by  seeking  that  K-th  order  filter 
which  minimizes  some  measure  of  "distance"  between 
jjo  and  its  quantised  version.  In  particular,  con¬ 
sider  the  integratad-squared-error  (ISE)  measure 


t 

*  I 

k-1 


I  \\ 


-  l> 


(U) 


For  given  grouping,  l.a.  L  ,  k-l,2,...,K,  it  is 
easy  to  show  that  the  niniium  ISE  is  obtained  for 
levels  H  k  satisfying 


"ok  "  I  W  I1’ 

qtl*  9*1^ 


Example  1  (Wiener  Filter) 

In  this  example  we  consider  a  15-saaple  esti¬ 
mation  problea  with  h,  -  (1,0,0, ... ,0]T.  The  sig¬ 
nal  and  noise  are  uncorrelated  so  that  R-S+N  and 
C-S,  where  the  ij-th  elements  of  the  signal  and 
noise  covariance  matrices  S  and  N  are  8.0  exp(-0.3* 
|l  -  jj)  and  6.0  exp(-0.8jl  -  j|),  respectively. 

The  optima  Wiener  filter  coefficient  vector  is 
h  -  (0.497,  0.729x10-1,  0.434xl0-1,  0.259xl0"1, 
0?154xl<rl,  0.919xl0-2,  0.548x10-2,  0.326xl0'2, 
0.193x10-2,  0.116x10-2,  0.691xl0-3,  0.413xl0-3, 
0.247x10  ,  0.149xl0“3,  0.137xl0-3]T,  giving  an  MSE 

of  3.251. 

For  second-order  quantisation  (R-2)  different 
initial  gasses  resulted  in  basically  two  type*  of 
quantisation  schemes  with  good  MSE  performance.  The 


(12) 


bast  USE  of  3.364  was  obtained  with  filter  levels  of 
(1)  0.942xl0-2  and  (2)  0.533,  distributed  In  tha 
obvious  way  over  the  15-sample  impulse  response 
sequence  as  {2  1  1  1  ...  1).  Many  of  the  runs  of 
Algorithm  I  with  different  initial  guesses  gave  a 
quantizer  with  levels  (1)  0.362xl0-z  and  (2)  0.304, 
distributed  as  (2  2  1  1  1  ...  1) ,  with  an  MSE  of 
3.705.  For  K»3  basically  vary  slailsr  results  were 
obtained,  with  inproveaents  In  MSE  performance  which 
are  not  major  because  of  the  good  results  for  K-2. 

For  this  example  one  conclusion  froa  the  above 
la  that  ualng  only  the  current  saaple  with  a  weight 
of  0.5  one  can  expect  good  results.  In  fact,  the 
resulting  MSE  la  3.5.  However,  the  results  above 
also  indicate  that  good  performance  any  be  obtained 
by  using  only  levels  of  0.3  for  the  first  two  aam- 
ples  (currant  and  previous  saaple),  with  zero 
weighting  for  the  others,  the  resulting  MSE  1s 
3.72.  The  possibility  of  such  a  scheme  la  not 
obvious  without  the  algorithm.  This  type  of  schema 
may  be  preferable  If  the  data  Is  subject  to 
occassional  random  higher-variance  contamination, 
because  the  averaging  over  two  samples  will  then 
provide  a  better  estimate.  In  general  the  use  of 
Algorithm  I  allows  generation  of  a  set  of  good 
quantizer  designs  from  which  a  specific  useful  or 
easily  Implemented  approximation  may  be  derived. 

For  simple  Implementation  the  modification  of 
Algorithm  I  may  be  used  to  determine  optimal  group¬ 
ing  once  a  good  set  of  levels  is  determined. 

For  this  example  with  K-2  the  beat-fit  quantizer, 
as  given  by  the  necessary  conditions,  turned  out  to 
have  levels  of  (1)  0.129x10-1  and<2)  0.497  for  all 
the  different  initial  guesses  that  were  tried.  The 
distribution  over  the  15  samples  was  tha  obvious  one, 
and  tha  resulting  MSE  was  3.407.  While  this  was 
very  close  to  one  of  two  the  previous  results,  note 
that  the  second  quantizer  would  not  have  emerged 
from  the  best-fit  criterion. 

Example  2  (Matched  Filter) 

Again  we  use  J-15.  The  deterministic  signal 
vector  £  Is  formed  from  uniformly  spaced  samples  of 
an  amplitude-tapered  sinusoidal  waveform.  Specif¬ 
ically,  we  take  s  *  2.5  cos[0.2*(l-l)]*cos(0.025* 

|  i— 1 1]  -  The  ij-th  element  of  the  input  noise  co¬ 
variance  matrix  is  assumed  to  be  0.5  exp(-0.fl|i-J | ). 
For  this  case  the  optiasim  matched  filter  coefficient 
vector  Is  h  -  {3.995,  2.399,  0.874,  -0.956,  -2.347, 
-2.761,  -2.085,  -0.659.  0.892,  1.938,  2.114,  1.454, 
0.343,  -0.693,  -1.8461  ,  giving  the  maximum  SNR  of 
42.61. 

For  third-order  quantization  (K«3)  different 
initial  guesses  for  Q  in  the  recursive  algorithm 
again  gave  several  different  results  which  were 
very  good  la  SHE  performance.  In  ell  cases  con¬ 
vergence  took  place  in  leas  than  7  iterations. 
However,  basically  two  distinct  types  of  quantized 
filters  emerge  from  the  different  initial  guaeses. 

Of  tha  twenty  different  trials  made,  the  best  SHE 
obtained  for  K*3  was  40.11,  obtained  with  levels 
(1)  -1.791,  (2)  1.178,  sad  (3)  3.003,  distributed 
over  the  15-sample  Impulse-response  as  (3  3  2  1  1  1 
112232211).  Many  Initial  guesses  gave 
optimum  levels  of  (1)  -1.777,  (2)  0.960,  and  (3) 
2.699,  distributed  as  (3  321111123322 
1  1)  with  an  SHE  of  39.72.  Another  basically  sim¬ 


ilar  type  of  quantizer  (with  levels  close  to  -2.0, 
1.0  and  3.0)  gave  an  SNR  of  39.96. 

Another  group  of  initial  guesses  gave,  for 
K“3,  the  levels  (1)  -2.187,  (2)  -0.172,  and  (3) 
2.293,  distributed  as  (3331111223332 
2  1),  with  an  SNR  of  39.54.  Again,  several  other 
guesses  gave  this  type  of  result  (with  levels 
close  to  -2.0,  0  and  2.0)  with  SNR's  very  dose  to 
39.54.  One  Interesting  indication  froa  this  is 
that  the  use  of  levels  -2,  0,  2  distributed  in  this 
way  should  give  good  results,  and  would  require 
only  one  bit  signed  coefficients.  Indeed,  the  SNR 
for  this  scheme  turns  out  to  be  39.46.  Thus  one 
use  for  the  theoretical  results  is  for  providing 
s  set  of  good  quantization  schemes  on  which  a 
choice  of  a  simple  scheme  may  be  based. 

The  candidates  for  best-fit  minimum  ISE 
quantizers  were  also  obtained  for  this  example. 
Interestingly,  while  the  specific  numerical  values 
are  different,  it  turns  out  that  the  resulting 
quantizers  also  fall  into  one  of  the  same  two 
basic  types.  The  best  quantizer  by  this  criterion, 
froa  the  initial  guesses  tried,  gives  levels  of  (1) 
-1.621,  (2)  0.891  and  (3)  2.611,  distributed  as 
for  the  similar  quantizer  based  on  maximizing  SNR, 
and  gives  an  SNR  of  39.69.  Thus  we  may  conclude 
that  the  best-fit  quantizer  gives  very  good  results 
for  such  examples.  This  implies  that  it  should  be 
reasonable  to  find  optimum  grouping  for  given 
levels  using  the  minimum  ISE  criterion,  since  no 
such  analytical  result  has  been  found  for  maxi¬ 
mizing  SNR. 
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